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1.  TITLE 

INTERLABORATORY  STUDY  (ILS)  FOR  F  428-83,  THE  STANDARD  TEST  METHOD 
FOR  INTENSITY  OF  SCRATCHES  ON  AEROSPACE  GLASS  ENCLOSURES 

Committee  F-7  on  Aerospace  and  Aircraft  Enclosures 
Subcommittee  F-7.08  on  Transparent  Enclosures  and  Materials 
RR  F07-1008 

2.  INTRODUCTION 

The  American  Society  for  Testing  and  Materials  (ASTM)  develops  and  publishes  standardized 
test  methods.  Each  test  method  requires  a  precision  and  bias  statement  so  organizations  that 
apply  the  method  know  its  inherent  reproducibility  (between-laboratory  variability)  and 
repeatability  (within-laboratory  variability).  Reproducibility  and  repeatability  for  this  test 
method  were  determined  by  conducting  an  interlaboratory  study  (ILS)  as  outlined  in  ASTM  E 
691.  This  report,  which  conforms  to  the  ILS  reporting  format  required  by  ASTM,  describes  the 
study  that  was  conducted  for  ASTM  test  standard  F  428-83,  Intensity  of  Scratches  on  Aerospace 
Glass  Enclosures. 

Scratches  exist  on  all  glass  surfaces.  Usually,  cleaning  procedures  cause  very  fine  scratches  that 
are  not  visible  when  looking  through  the  glass.  Visible  scratches  may  be  distracting  to  an 
observer  looking  through  a  transparent  aerospace  enclosure.  Therefore,  a  procedure  to  define 
scratches  is  useful.  A  visual  comparison  is  made  between  a  set  of  graded  scratch  standards 
(adjuncts)  and  a  scratch  on  the  glass  transparency  to  determine  its  relative  intensity.  A  visual 
standard  is  used  because  it  is  not  practical  to  measure  the  dimensions  of  the  fine  scratches. 

3.  TEST  METHOD 

See  ASTM  F  428-83,  Standard  Test  Method  for  Intensity  of  Scratches  on  Aerospace  Glass 
Enclosures 


4.  LIST  OF  PARTICIPATING  LABORATORIES 

AFRL/HECV 

2255  H  St.  Room  300 

Wright-Patterson  AFB,  OH  45433-7022 


Sierracin/Sylmar  Corp, 
12780  San  Fernando  Rd. 
Sylmar,  CA  91342 


PPG  Industries,  Inc. 
1719  E.  Highway  72 
Huntsville,  AL  35811 


Pilkington  Aerospace 
12122  Western  Ave. 
Garden  Grove,  CA  92841 


University  of  Dayton  Research  Institute  Texstars,  Inc. 

300  College  Park  Ave.  802  Ave  J  East 

Dayton,  OH  45469-01 10  Grand  Prairie,  TX  75053 


Boeing  Co. 

800  N.  6th  St.,  10.20  Bldg.  Lobby 
Renton,  WA  98055 
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5.  INTERLABORATORY  TEST  PROGRAM  INSTRUCTIONS 

Cover  letter  for  test  instructions  to  participating  laboratories: 

Subject:  ASTM  Interlaboratory  Study  (ILS)  for  Measuring  Intensity  of  Scratches  on 

Aerospace  Enclosures 

To:  Participating  Organization 

From:  Alan  Pinkus 

AFRL/HECV,  2255  H  St  Room  300 

Wright-Patterson  AFB  OH  45433-7022 

Dear  Colleague, 

As  part  of  ASTM  Committee  7.08  standards  writing  activity,  we  are  conducting  an  ELS  in 
order  to  ascertain  the  precision  of  Standard  Test  Method  for  Intensity  of  Scratches  on 
Aerospace  Enclosures,  F  428-83.  Since  this  method  has  a  numerical  result,  it  requires  a 
precision  statement.  After  the  ILS,  F  428-83  will  be  revised  to  include  a  precision  statement. 

Your  participation  in  this  study  is  greatly  appreciated.  No  data  will  be  released  with  any 
company  or  individual  identification  labels.  The  data  in  the  ILS  report  to  ASTM  are  given 
generic  labels  and  the  final  precision  statement  uses  only  summary  statistics  as  outlined  in 
ASTM  E  691  and  ASTM  E  177.  If  there  are  any  questions,  please  do  not  hesitate  to  contact 
Alan  Pinkus  (937-255-8767). 

Sincerely, 

Alan  Pinkus,  Ph.D. 


6  Attachments: 

1.  ASTM  F  428-83  Standard  Test  Method 

2.  6-Piece  Set  of  Aerospace  Scratch  Standards  for  Glass 

3.  12  Glass  Scratch  Samples 

4.  Test  Instructions 

5.  Data  Sheet 

6.  Return  Address  Label 

Test  Instructions: 

Your  task  is  to  determine  the  scratch  intensity  levels  of  different  scratch  samples. 

1.  Complete  the  background  information  on  the  data  sheet. 

2.  There  are  12  glass  scratch  samples  and  6  scratch  test  standards.  The  12  glass  scratch 
samples  to  be  compared  to  the  scratch  test  standards  and  rated  are  labeled  A  through  L. 

The  6  scratch  test  samples  are  labeled  3  through  8  and  are  stored  in  the  brown  wooden  box 
labeled  Aerospace  Scratch  Standards  for  Glass.  Caution:  these  ASTM  standards  cost 
$1500  per  set. 

3.  Beginning  with  trial  #1  on  the  data  sheet,  select  the  designated  scratch  sample  (A 
through  L)  and  place  in  an  angled  position  to  allow  for  optimum  visual  definition  of  the 
scratch.  Please  handle  the  scratch  samples  and  standards  by  the  edges  only  to  avoid 
getting  fingerprints  on  them.  If  they  become  dirty,  carefully  wipe  using  the  supplied  cloth. 
Since  they  are  laminated,  Do  Not  immerse  in  any  liquid.)  The  light  level  required  for 
judgment  is  a  minimum  of  80  lux.  Natural  or  artificial  light  may  be  used.  Determine  the 
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rating  of  the  scratch  sample  by  comparing  it  to  the  scratch  test  standards  by  placing  the 
test  standards  next  to  the  scratch  sample,  one  at  a  time.  Select  the  test  standard  (3  through 
8)  that  most  closely  matches  the  scratch  sample.  Disregard  scratch  lengths.  Record  the 
scratch  level  number  in  the  rating  column  located  on  the  data  sheet.  Repeat  this 
procedure  for  all  60  trials. 

4.  Return  your  data  sheet,  the  12  glass  scratch  samples  and  the  6  scratch  test  standards  to 
Alan  Pinkus,  AFRL/HECV,  2255  H  St,  Room  300,  Wright-Patterson  AFB  OH  45433- 
7022.  Note:  The  packaging  has  been  designed  for  reuse  for  both  your  convenience  and  to 
assure  full  protection  of  the  delicate  test  pieces.  A  return  address  label  has  been  included. 
Please  insure  the  contents  for  $1500. 

Sample  Data  Sheet: 


ASTM  Intensity  of  Scratches  Interlaboratory  Study  Data  Sheet 
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Date: 
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6.  DATA  REPORT  FORMS 

See  Appendix  A 

7.  STATISTICAL  DATA  SUMMARY 

Thirty-one  trained  observers  rated  12  glass  scratches.  Each  scratch  was  rated  five  times  by  each 
observer.  The  60  trials  for  each  observer  were  randomized  with  the  constraint  that  there  be  at 
least  10  trials  between  replications  of  the  same  scratch.  Observers  were  provided  adjuncts  that 
had  scratch  ratings  of  3, 4, ...,  8  (3  is  the  thinnest  and  8  is  the  thickest).  For  an  individual  trial, 
the  observer  would  place  one  of  the  12  scratches  next  to  the  adjuncts  and  determine  the  closest 
match.  Figures  2a  &  2b,  show  the  number  of  trials  for  each  observer  and  scratch  having  a 
particular  scratch  rating.  Table  1  shows  the  judged  rank-order  of  the  glass  scratch  samples. 
Figure  1  contains  the  percent  of  the  155  total  trials  (31  observers  x  5  replications)  for  each 
scratch  having  a  particular  scratch  rating. 


Table  1.  Rank-order  of  glass  scratch  samples. 


Scratch 

Mean  Rating 
(N  =  155) 
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Legend  is  percent  of  trials  (N  =  1 55) 


Figure  1.  Percent  of  all  trials  for  each  scratch  (N  =  155)  having  a  particular  scratch  rating. 
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Of  interest  is  how  consistently  the  observers  rated  each  scratch  for  their  5  replications  and  how  close 
scratch  ratings  were  from  one  observer  to  another.  For  continuous  variables,  repeatability  and 
reproducibility  limits  could  be  determined  using  the  normal  distribution  where  95th  percentiles  for 
absolute  difference  in  trials  are  estimated.  The  discrete  ratings  in  this  data  does  not  lend  itself  to  this 
type  of  analysis.  Instead,  the  percent  of  all  absolute  differences  in  trials,  both  within  and  between 
observers,  was  calculated  for  each  possible  absolute  difference  (i.e.,  0  to  5).  Results  are  shown  in  Table 
2.  Cumulative  percents  are  shown  in  Table  3. 


Table  2.  Mean  rating  across  all  observers  and  trials  (N  =  155)  and  percent  of  absolute 
difference  in  trails  both  within  (N  =  31  observers  *  10  paired  reps  per  observer  =  310) 
and  between  (N  =  3 1  observers  *  (5  reps  *  150  other  trials)/2  =  1 1625)  observers. 


Scratch 

Mean 
Rating 
(N  =  155) 
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0 

1 

2 

3 

0 

1 

2 

3 

4 

j 

3.0 

W3M 

3.9 

96.2 

3.8 

D 

3.3 

F/ia 

7.1 

0.3 

n 

L 

4.1 

81.3 

15.5 

MiltM 

ream 

KX9 

0.4 

H 

4.2 

88.1 

KIM 

59.9 

EM 

12.4 

0.9 

A 

4.2 

83.2 

12.3 

■ 

47.5 

44.4 

MM 

■LilM 

I 

4.6 

73.5 

21.9 

Ka 

42.4 

BUM 

mwm 

B 

4.7 

78.1 

reiliB 

mm 

ESI 

rega 

JgjgJ 

F 

5.3 

63,2 

KM 

EH 

ream 

■m 

1.5 

E 

6.4 

71.0 

E£I1 

3.2 

0.3 

38.3 

44.2 

IEEEI 

ren 

0.02 

G 

7.8 

92.3 

Mtlfl 

66.3 

33*7 

■ 

K 

7.9 

96.8 

3.2 

74.0 

26.0 

c 

8.0 

100 

100 

Table  3.  Mean  rating  across  all  observers  and  trials  (N  =  155)  and  cumulative  percent  of 
absolute  difference  in  trails  both  within  (N  =  31  observers  *  10  paired  reps  per  observer 
=  310)  and  between  (N  =  31  observers  *  (5  reps  *  150  other  trials)/2  =  11625)  observers. 
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Figure  2a.  Number  of  trials  for  observers  1-16  and  scratch  (N  =  5)  having  a  particular  scratch  rating. 


6 


Legend  is  number  of  trials  Scratch 

•  Mean  across  observers  and  trials 


Figure  2b.  Number  of  trials  for  observers  17-31  and  scratch  (N  =  5)  having  a  particular  scratch 
rating. 

8.  RESEARCH  REPORT  SUMMARY 

Standard  repeatability  and  reproducibility  analyses  (ASTM  E  691)  cannot  be  applied  to  these 
data  since  they  are  discrete  instead  of  continuous.  The  cumulative  percent  of  the  absolute 
difference  in  trials  data  shown  in  Table  3  best  delineate  the  within-laboratory  (observer)  and 
between-laboratory  variability  that  may  be  expected  for  this  test  method. 
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9.  PRECISION  and  BIAS 

Precision  -  The  repeatability  of  judging  the  intensity  of  a  scratch  within  one  scratch  value,  for 
the  same  observer,  is  90%  or  better. 

The  reproducibility  (between  observers)  of  judging  the  intensity  of  a  scratch  within  two  scratch 
values  is  87%  or  better. 

Bias  -  The  procedure  in  this  test  method  has  no  bias  because  the  scratch  intensity  is  defined  only 
in  terms  of  the  test  method. 

Note:  A  study  was  performed  to  determine  equivalent  relationships  between  glass  and  plastic 
scratch  adjuncts.  This  empirically  derived  relationship  can  be  used  if  needed  when:  (1)  only 
glass  adjuncts  are  available  to  judge  the  intensity  of  scratches  in  plastic,  (2)  only  plastic  adjuncts 
are  available  to  judge  the  intensity  of  scratches  in  glass  or  (3)  it  is  desirable  to  convert  the 
between  the  glass  and  plastic  scales.  The  data  and  conversion  formula  are  presented  but  the 
precision  was  not  determined.  Please  refer  to  Appendix  B. 


8 


APPENDIX  A 


Data  report  forms: 
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APPENDIX  B 

Comparison  of  Glass  and  Plastic  Scratch  Ratings  (non-mandatory  information): 

A  study  was  performed  to  determine  equivalent  relationships  between  glass  and  plastic  scratch 
adjuncts.  This  empirically  derived  relationship  can  be  used  if  needed  when:  (1)  only  glass  adjuncts  are 
available  to  judge  the  intensity  of  scratches  in  plastic,  (2)  only  plastic  adjuncts  are  available  to  judge  the 
intensity  of  scratches  in  glass  or  (3)  it  is  desirable  to  convert  the  between  the  glass  and  plastic  scales. 

Five  trained  observers  rated  eight  glass  and  eight  plastic  scratches.  Each  scratch  was  rated 
using  both  glass  and  plastic  adjuncts  three  times.  The  96  trials  for  each  observer  were  randomized  with 
the  constraint  that  there  be  at  least  five  trials  between  replications  of  the  same  scratch  and  either  glass  or 
plastic  adjunct.  Figure  3  shows  the  number  of  trials  for  each  observer  and  scratch  having  a  particular 
scratch  rating. 

Figure  1  contains  the  estimated  relationship  between  the  glass  (G)  and  plastic  (P)  scratch  ratings 
and  between  the  plastic  and  glass  ratings.  Table  1  and  Figure  2  contain  the  mean  scratch  rating  for  each 
scratch. 
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Figure  1.  Non-linear  regression  fit  of  mean  scratch  ratings  (N  =  15).  The  3  means 
near  (P  =  1 1,  G  =  3)  and  the  2  means  near  (P  =  15,  G  =  8)  were  not  used  since  they 
contained  multiple  trials  where  the  glass  rating  was  either  3-  or  8+. 
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Table  1.  Mean  glass  and  plastic  scratch  rating  for  each  scratch  (N  =  15). 
Ratings  are  sorted  by  glass  adjunct. 


Scratch 

Material 

Scratch 

Mean  Rating  (N  =  15) 
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Plastic  Adjunct 
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Glass  Scratch  Plastic  Scratch 


Figure  2,  Mean  glass  and  plastic  scratch  rating  for  each  scratch  (N  =  15). 
Solid  line  segments  connect  means  in  this  study  with  means  from  previous 
studies  involving  glass  or  plastic  only. 
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Figure  3.  Number  of  trials  for  each  observer  and  scratch  (N  =  3)  having  a  particular 
scratch  rating  when  compared  with  either  glass  or  plastic  adjunct. 
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